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This paper deals with the analysis of data sets of stochastic systems which can be described by a Langevin equation. By the method presented in this 
paper drift and diffusion terms of the corresponding Fokker-Planck equation can be extracted from the noisy data sets, and deterministic laws and 
fluctuating forces of the dynamics can be identified. The method is validated by the application to simulated one- and two-dimensional noisy data sets. 
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L INTRODUCTION 

oo : 

Q\ • In biological, economical, physical or technical systems 
^Tioisy data sets occur very frequently. For describing and/or 
influencing these complex systems, it is necessary to know 
l «^She deterministic laws and the strength of the fluctuations 
'controlling the dynamics. Especially in the dynamics of or- 
^^er parameters close to instability points fluctuations play 
an important role Nil], [Q], ph. This paper discusses a ge- 
^Tieral method which allows one to determine drift and diffu- 
sion coefficients of the Fokker-Planck equation for station- 
ly-yy continuous complex systems with Markov properties. So 
Oil complete description of the stochastic process is found. 
£^Tjis problem has also been addressed by [Q] and ||5|], but in 
0© different way. 
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II. BASIC RELATIONS 
A. Langevin equation and Markovian property 



The dynamics of a continuous Markovian system is gov- 
^rjied by a Langevin equation (|J) for a set of n variables 
.%q k (t)},k = l,...n^: 



d . . 



hi({q k (t)}, t)+J2 9ij{{qk{t)}, t)Tj(t) 



(1) 



1, . . . n 



The fluctuating Langevin forces Fj (t) are considered to 
be (5-correlated noise functions with vanishing mean as ex- 
pressed in equation (0) and (0). 



conditional probability density distributions p, the condition 
for the validity of Markovian property can be expressed by 
equation © [j], [§]. 



p{qn,t n j <Zn-i>*n-i;--- ;qi,tx) = 

w(q n ,t n ; . . .;q 1 ,t 1 ) 



u>(q n -i,t n ~i; ■ ■ ■ ;qi,h) 



(4) 



/ w(q n ,t n ; . . . ; qi,h) Jli dq% is the probability to find the 
system in qi . . . qi + dqi at time t, for all i. 



P{qn, t n I ? n -l)*n-lj • • • i <Zl; *l) — P\Qn, t n \ ?n-lj Ui-l), 

(5) 

tn > tfi-i > ... > ti, 

where is the next earlier time before t n . 

This condition can be validated by analysing the data 
sets numerically, as has been shown by [§J. In case that 
the Markovian property does not fit, the dimension of the 
state vector can be increased by including a further observ- 
able. This can always be achieved by introducing delay co- 
ordinates. Thus by introducing new random variables, non- 
Markovian processes may be reduced to Markovian systems 



B. Fokker-Planck equation 

Usually a formal general solution of the stochastic dif- 
ferential Langevin equation (|l|) cannot be given. Therefore 
a Fokker-Planck equation @ is set up by which the probabi- 
lity density distribution w({qk(t),t}) of the stochastic vari- 
ables can be calculated [ |To[ ] : 



<Ti(t)> Vi (2) 

<r i (*)r i (0> = Q'&ijS(t-t?)Vi,j (3) 

The condition of Markovian property demands that the 
dynamics of the process depends only on the present state 
of the system and not on its history. With definition (Q) for 



-w({q k (t),t}) 
n f) 

-Efl-( D < (1) (te(*)},*M{ft(t)},*)) 
1=1 aqi 

1 n pp' 

+ 2 £ Q-^~ (D\f({q k (t)},tMtik(t)},t))(6) 



The coefficients D\ are called drift coefficients, the 

(2) 

terms D\-' diffusion coefficients, they are defined in equa- 
tion (0) and (|) @]. 

D^({q(t)},t) = hml(^(t + r )- % )| { - fc(t)}={9} 

+00 

= !im - / (</i(* + ' r ) - ft) ' 

—00 

* + t \ {qk}, t) Y[ dq k (7) 

k 

Df){{q k {t)},t) = Iim-<(ft(t + r)- 9i )- 

fe(* + ^)-?i))lfe W }= te } 
+00 

= lim - / (qi(t + r) -qi) ■ 
t^o r J 

—00 

(qj(t + r) -qj) ■ 

p{{qk},t + r I (8) 

A; 

k = 1, . . . n 



III. ANALYSIS OF STOCHASTIC DATA SETS 

A continuous Markovian system in the presence of white 
noise is governed by a Langevin equation ([[]) respectively by 
the corresponding Fokker-Planck equation (^). A complete 
analysis of such a complex system, therefore, should yield 
the quantities hi and gij of the Langevin equation ([I]) re- 
spectively drift and diffusion coefficients and of 
the Fokker-Planck equation @. Both sets of terms are ac- 
cording to @ and ( JT0[ ) correlated with each other. 

For the regarded class of stationary continuous Marko- 
vian systems with white dynamical noise, where the validity 
of the Markovian property may have been achieved by the 
introduction of delay coordinates, it is always possible to de- 
termine drift and diffusion terms directly from the data sets 
by using the equations (^), ([7]) and (||). Because of the sta- 
tionarity, D^p and have no explicit time dependence. 
The needed conditional probability density distribution can 
be determined numerically from the data set according to (Q) 
by calculating histograms. 

This general algorithm has apparently not been recog- 
nized in literature up to now. The numerical method is com- 
pletely general, no ansatz for the coefficients is needed. If 
analytical formulas for the evolution equations of a process 
are needed, the gained numerical results may be approxi- 
mated by analytical functions. 



where {q k (t + r )} with r > is a solution of ([[]) which at 
time t has the sharp value {q k {t)} = {qk}- 

In [11] an application of these equations (f7|) and (||) to- 
gether with the definitions of conditional probability density 
distributions (|j) to the statistical properties of a turbulent 
cascade is discussed. 

The relations between the sets of coefficients of the Lan- 
gevin equation and the Fokker-Planck equation in consider- 
ation of the Stratonovich definitions are [0] 



Df\{q k (t)},t) = h l {{q k {t)},t) 

Q d 
+ ^Y.9lj{{Qk(t)},t)—g ij {{q k {t)},t) 

(9) 

4 2) (Uk(t)},t) 



= Q ■ J2su(Uk(t)},t) gj i({q k (t)},t) (10) 



IV. APPLICATIONS OF THE PRESENTED 
ALGORITHM 

In the following the discussed algorithm will be applied 
to various one- and two-dimensional synthetically deter- 
mined data sets. 

A. First example 

The first example deals with the case of one-dimensional 



systems, following the Langevin equation (11) 

q(t) = eq(t) - q(t) 3 + T(t) 



(11) 



which is valid for systems exhibiting noisy pitchfork bifur- 
cations. Figure [T] presents a part of the calculated noisy time 
series. 
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FIG. 1 : Variable q versus time t. The time series is calculated according 

to the Langevin equation 

q(t) = 0.1g(t) - q 3 (t) + 0.05 ■ F(t), 

where F(t) is a Gaussian distributed fluctuation force. 
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FIG. 2: Drift and diffusion coefficient D' 1 ' and D^ 2 ' versus variable q: 
According to the discussed algorithm the conditional probability distri- 
bution of the noisy time series shown in figure |l| has been determined and 
drift and diffusion terms have been calculated. The dots exhibit the nu- 
merically determined values, the lined curves show the theoretical func- 
tions for the coefficients according to equation (^) and jlo|). 



B. Second example 



Figure || shows drift and diffusion terms for this time 
series, calculated by determining the conditional probability 
density distribution for the variable q and using equations 
# and (§). 



The second example is concerned with the case of one- 
dimensional systems following the Langevin equation (fl2[). 

4> = w + sin(» +T(t). (12) 

This type of equation describes the dynamics of a phase 
difference cj> = — 4>2, where 4>i, <f>2 are the phases of 
two coupled nonlinear oscillators. For two different sets of 
parameters the noisy time series and calculated drift coeffi- 
cients are shown in fig. || and |J Because of the singularities 
of the time series there is only a small probability for the 
corresponding variable values. These rapid changes of the 
phase are responsible for the strong noise of the drift coeffi- 
cient. 
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FIG. 3: Phase Difference versus time t and drift coefficient 
versus cj>: The noisy time series belongs to the Langevin equation 
4>(t) = 0.2 + sin(</>(*)) + 0.6 • Fit) 

where F(t) is a Gaussian distributed fluctuating force. The corresponding 
drift coefficient has been calculated and is plottet (dots) together 
with the theoretical function (lined curve). 
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FIG. 4: Phase Difference 4> versus time t and drift coefficient 
versus <j>: The noisy time series belongs to the Langevin equation 

cj>{t) = 1.0 + sm{(j){t)) + 0.05 ■ F(t) 

where F(t) is a Gaussian distributed fluctuating force. In the second part 
of the figure the numerically determined corresponding drift coefficient 
D"' is plottet together with the theoretical function (lined curve). 



Since the Langevin equation (|l2|) is valid for a wide class 
of biological systems applications of the algorithm for many 
different fields are expected. 

C. Third example 

After these two examples of one-dimensional systems 
the case of two variables will be discussed. In the following 
examples the presented method will be applied on vectors 
with two components. The third example is based on the 
differential equation system of a Hopf bifurcation: 



792 + (#l + qDiMi - uq2) (13) 
eq 2 + (qj + qj)(uqi + Ml) ( 14 ) 

Fig. IH shows the phase diagram of the qi and q 2 - The 
parameters 



dt 
d_ 

~dt 



Q2 



eqi - 
111 



are chosen in a way that the behaviour of the variables 
becomes supercritical, i.e. the focus (0,0) is instable and the 



trajectory moves towards a stable limit cycle Q12p. This sys- 
tem of differential equations is very important for describing 
time-spatial signals whose dynamics are determined by two 
order parameters. 
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FIG. 5: Variable q 2 versus variable q%: The phase diagram shows the 

dynamics of a Hopf bifurcation: 

qi = 0.05gi - q 2 + {ql + <&)(-5qi - 7.5q 2 ) 

q 2 = qi- 0.05g 2 + (qf + &)(7.5qi - 5g 2 ) 
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A Gaussian distributed white noise weighted by a fac- 
tor 0.2 has been added to the system described by equations 
(13) and (|H]). Afterwards the presented method has been 
applied. Fig. |6] shows the two numerically determined drift 
coefficients Dq^ (q) and (q). The lined surface belongs 
to the calculated terms, the dashed one to the expected sur- 
face. The differences at the borders are caused by too few 
variable values in these regions. These values are taken only 
from a few stochastic realizations, so that the algorithm can- 
not work with great accuracy. In the main field a good con- 
formance between calculated and expected surfaces can be 
seen. 



FIG. 6: Drift coefficients D$ and D$ versus variables q± and q 2 : 

The lined surfaces belong to the calculated data, the dashed surfaces are 

plottet according to the expected surfaces: 

D 91 (l)(q) = 0.055! -Q2 + {ql + g 2 )(-5gi - 7.5g 2 ) 

D q2 (l)(q) = qi - 0.05g 2 + {ql + g 2 2 )(7.5 gi - 5g 2 ) 



D. Fourth example 

The fourth example deals with the case of a co-dimen- 
sion II system. The dynamics of such a system is determined 
by the differential equations ( |l6| ) and (|l7|) 



j t qi = q2 + F 1 (t) (16) 
= eqi + 792 + Mi + uq\q2 + F 2 (t) (17) 



The parameters have been chosen as 



e = 0.01, 7 = 0.03, li = -I, oj = -1. 

(18) 

The fluctuation force F(t) has been taken as a Gaussian 
distributed noise weighted by a factor 0.05. 

Fig. ^ shows the phase diagram for this system without 
a fluctuating force F(t). The trajectory is repelled from the 
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FIG. 7: Variable q 2 versus variable q%: The phase diagram shows the 
dynamics of a co-dimension II instability: 

<?i = <?2 

q 2 = 0.02gi + 0.03g 2 - qf - q\q 2 
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FIG. 9: Diffusion coefficient D q 2 iq2 versus variables qi and q 2 : As 

(2) 

representative for the diffusion coefficients, D qiq2 has been calculated 
and drawn as lined surface. The dashed surface belongs to the expected 
diffusion coefficient 
d£L = 0.0025 



Fig. || illustrates the drift terms D q J(q) and D q2 (q), 
calculated by the presented method, together with the ex- 
pected terms for the noisy system (|l6|)-(|T8|). In fig. ^ one of 
the calculated diffusion coefficients, ^^(q), and its theo- 
retical function can be seen. 
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FIG. 8: Drift coefficients and D$ versus variables qi and q 2 : 
The lined surfaces belong to the calculated data, the dashed surfaces are 
drawn according to the expected surfaces: 

Dg> (q) = 0.02 ?1 + 0.03g 2 - qf - q\q 2 



V. SUMMARY AND OUTLOOK 

By the discussed method noisy data sets that obey a 
Fokker-Planck equation can be analysed and described. By 
a numerical determination of the conditional probability dis- 
tributions drift and diffusion coefficients can be calculated. 
Consequently the deterministic laws and the weight of the 
fluctuating forces underlying the dynamics of the system can 
be extracted. 

The algorithm has been illustrated on various one- and 
two-dimensional systems, whose noisy time series have been 
simulated and afterwards analysed. A good conformance 
between determined and expected drift and diffusion coeffi- 
cients can be seen. 

In biological, physical, technical and economical sys- 
tems noisy data sets referring to a Fokker-Planck equation 
occur very frequently. The presented method offers the pos- 
sibility of analysing these systems and describing them in a 
mathematical way without the need of any form of ansatz or 
assumption. Therefore, there seems to be a broad field of a 
possible use of this algorithm. 
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